Display device, user terminal apparatus and control method thereof

ABSTRACT

A control method of a display device includes receiving identification (ID) information of an electronic devices connected to the display device; determining whether a remote controller includes a control setting for the electronic device based on the received ID information, wherein the remote controller controls a plurality of electronic devices associated with the display device; obtaining a control key of the remote controller corresponding to the ID information when it is determined that the remote controller does not include the control setting for the electronic device; and transmitting the obtained control key to the remote controller.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priorities from Korean Patent Application No.10-2013-0044130, filed on Apr. 22, 2013, and Korean Patent ApplicationNo. 10-2013-0057227, filed on May 21, 2013, in the Korean IntellectualProperty Office, the disclosures of which are incorporated herein byreference in their entireties.

BACKGROUND

1. Field

Apparatuses and methods consistent with the exemplary embodiments relateto a display device, a user terminal apparatus and a control methodthereof, and more particularly, to a display device which receivesidentification (ID) information of peripheral electronic devicesconnected to the display device, receives a control key of a remotecontroller with respect to electronic devices to which no remotecontroller has been set, and transmits the control key to the remotecontroller, a user terminal apparatus which receives ID information ofelectronic devices through an image and an audio, and receives a controlkey corresponding to the electronic devices, and remotely controls theelectronic devices with the received control key, and a control methodthereof.

Apparatuses and methods consistent with the exemplary embodimentsfurther relate to a display device, a user terminal apparatus and acontrol method thereof which allows a user to remotely controlelectronic devices with the user terminal apparatus or the displaydevice if a user logs in to a user account of the user terminalapparatus or the display device.

2. Description of the Related Art

A multi-brand remote control (MBR) function is used to control devicesconnected to a television (TV) with a single remote controller of asmart TV or a user terminal apparatus having a remote control function.Thus, by using the MBR function, various devices such as a home theater,a blue-ray player, a set-top box and other electronic devices connectedto the TV may be controlled by a single remote controller.

To set a remote controller, a user needs to manipulate a remote controlsetting menu, set an input port and perform a remote controlleroperation test for each type of remote controllers. If the remotecontroller does not operate, the user needs to input a model name ofperipheral devices (e.g., a home theater, a blue-ray player, a set-topbox, etc.).

The user is provided with a complicated setting screen for remotecontroller setting and needs to set, for example, channel up/down andmenu keys. If the remote controller does not operate, the user needs tofind a normally operating remote controller by switching each type ofthe remote controllers.

During the remote controller setting, the user may set channel input andpress menu keys for each type of remote controllers. If the remotecontroller does not operate, the user needs to repeat an operation testall over again for each type of remote controllers until the user findsa normally operating remote controller control key. This causesinconvenience to the user in performing the operation test. If theremote controller setting is not performed even after changing the typeof the remote controller, the user needs to find and input amanufacturer and a model name. Even if the device has the remotecontroller setting previously performed thereon, if the input port ischanged, the remote controller setting needs to be performed again.

Recently, TV peripheral devices (e.g., a set-top box, a home theater, ablue-ray player, etc.) support high definition multimedia interface(HDMI). Thus, it is required to automatically set data of the TVperipheral devices including the manufacturer and the model name asconsumer electronics control (CEC) information through HDMI-CEC ratherthan directly setting the remote controller by the user. In this manner,a complicated setting process may be avoided and a simple and easyremote controller setting may be achieved.

Further, in finding the control key of the remote controller, the useris required to perform a complicated setting process including inputtingthe model name, and remote control setting information of the electronicdevice is not shared between the remote controller and the user terminalapparatus. If a remote control setting is performed for an electronicdevice which may be wirelessly connected, the user needs to input the IDinformation, e.g., the model name, etc. of the electronic device, whichcauses inconvenience to the user.

If a remote control is to be set through a remote control application ofthe user terminal apparatus, a remote control setting screen isdisplayed. If the user does not know the ID information, e.g., the modelname, of the electronic device for which the remote control is to beset, the user needs to search for and input the model name of theelectronic device. Such complicated setting processes causesinconvenience to the user.

SUMMARY

Accordingly, one or more exemplary embodiments provide a display deviceand a control method thereof which obtains ID information of peripheralelectronic devices connected to the display device, receives a controlkey of a remote controller corresponding to an electronic device, towhich no remote controller has been set, and transmits the control keyto the remote controller to automatically set the control key based onthe ID information, and a user terminal and a control method thereofwhich receives ID information of an electronic device through an imageand an audio, receives a control key corresponding to the electronicdevice, and remotely controls the electronic device by using thereceived control key.

Another exemplary embodiment is to provide a user terminal apparatus, adisplay device, and a control method thereof which logs in a useraccount of an external server through the user terminal or the displaydevice, and performs remote control setting for an electronic devicethrough the user terminal apparatus and a remote controller without muchdifficulty.

According to an exemplary embodiment, provided is a control method of adisplay device, the control method including: receiving identification(ID) information of an electronic device connected to the displaydevice; determining whether a remote controller includes a controlsetting for the electronic device based on the received ID information,wherein the remote controller controls a plurality of electronic devicesassociated with the display device; obtaining a control key of theremote controller corresponding to the ID information when it isdetermined that the remote controller does not include the controlsetting for the electronic device; and transmitting the obtained controlkey to the remote controller.

The ID information may include information of at least one of amanufacturer and a model name of the electronic device.

The receiving may include receiving the ID information from theelectronic device through high definition multimedia interface-consumerelectronics control (HDMI-CEC).

The receiving may further include determining whether an HDMI connectionport is changed; and changing an HDMI connection port setting andreceiving the ID information from the electronic device using thechanged HDMI connection port setting when the HDMI connection port ischanged.

The obtaining may include receiving the control key from the electronicdevice.

The obtaining may include requesting an external server to transmit thecontrol key corresponding to the ID information of the electronicdevices and receiving the control key from the external server.

The control method may further include notifying a user of theelectronic devices for which no control setting has been performed onthe remote controller and displaying a user interface (UI) for a user toselect performing control setting of the electronic device.

According to another exemplary embodiment, provided is a display deviceincluding: an interface part configured to receive ID information of anelectronic device connected to the display device; a communication partconfigured to transmit and receive data; and a controller configured todetermine whether a remote controller which remotely controls aplurality of electronic devices associated with the display deviceincludes a control setting of the electronic device, based on thereceived ID information, and when it is determined the remote controllerdoes not include the control setting of the electronic device, controlthe communication part to obtain a control key of the remote controllercorresponding to the ID information and transmit the obtained controlkey to the remote controller.

The ID information may include information of at least one of amanufacturer and a model name of the electronic devices.

The interface part may be connected to the display device through anHDMI, and the controller may control the interface part to receive theID information of the electronic device from the display device throughthe HDMI.

The controller may determine whether an HDMI connection port has beenchanged, and if so, change an HDMI connection port setting and receivesthe ID information using the changed HDMI connection porting setting.

The controller may receive the control key from the electronic device.

The controller may request an external server to transmit the controlkey corresponding to the ID information of the electronic device andreceive the ID information from the external server.

The display device may further include a user interface (UI) generatorconfigured to display a UI, and the controller may notify the electronicdevice for which no control setting has been performed on the remotecontroller, and control the UI generator to display a UI for a user toselect performing control setting of the electronic device.

According to still another exemplary embodiment, provided is a controlmethod of a user terminal apparatus, the control method including:executing an application for remote control of an electronic device;inputting ID information of the electronic device including at least oneof an image and an audio related to the electronic device; obtaining acontrol key corresponding to the electronic device based on the input IDinformation; and remotely controlling the electronic device by using theobtained control key.

The inputting may include analyzing the at least one of the receivedimage and the received audio and determining the ID information of theelectronic device.

The executing may include identifying the electronic device which iscapable of connecting to the user terminal apparatus and a displaydevice associated with the electronic device.

The obtaining may include setting a connection port with respect to theelectronic device and the display device, respectively.

The obtaining the control key may include receiving the control key fromat least one of the electronic device, the display device, and anexternal server.

The control method may further include: connecting to an external serverand logging in a user account of the external server; and transmittingremote control setting information corresponding to the electronicdevice to the external server to upload the remote control settinginformation to the user account.

The remote control setting information may include the control keycorresponding to the electronic devices.

According to still another exemplary embodiment, provided is a userterminal apparatus including: an input part configured to receive IDinformation of an electronic device including at least one of an imageand an audio related to the electronic device; a storage configured tostore an application for remote control of the electronic device; acommunication part configured to transmit and receive data; and acontroller configured to obtain a control key corresponding to theelectronic device based on the input ID information and controls theapplication to remotely control the electronic device by using theobtained control key.

The input part may include a camera to capture the image and amicrophone to receive the audio, and the controller may analyze thecaptured image and the received audio and determine the ID informationof the electronic device.

The controller may identify the electronic device which is capable ofconnecting to the user terminal apparatus and a display deviceassociated with the electronic device.

The controller may set a connection port with respect to the electronicdevice and the display device, respectively.

The controller may receive the control key from at least one of theelectronic device, the display device, and an external server.

The controller may be connected to an external server and logs in a useraccount of the external server and transmit remote control settinginformation corresponding to the electronic device to the externalserver to upload the remote control setting information to the useraccount.

The remote control setting information may include the control keycorresponding to the electronic device.

According to still another exemplary embodiment, provided is a controlmethod of a user terminal apparatus, the control method including:connecting to an external server and logging in to a user account of theexternal server; receiving remote control setting information of anelectronic device uploaded to the user account; and remotely controllingthe electronic device by using the received setting information.

According to still another exemplary embodiment, provided is a userterminal apparatus including: a communication part configured totransmit and receive data; a user input part configured to receive auser's input; and a controller configured to control the communicationpart to be connected to an external server and log in the externalserver with a user account, to receive remote control settinginformation of an electronic device uploaded to the user account, and toremotely control the electronic device by using the received settinginformation.

According to still another exemplary embodiment, provided is a controlmethod of a display device, the control method including: obtainingremote control setting information corresponding to an electronic deviceconnected to the display device; transmitting the obtained remotecontrol setting information to a remote controller; connecting to anexternal server and logging in the external server with a user account;and transmitting the remote control setting information to the externalserver to be uploaded to the user account.

According to still another exemplary embodiment, provided is a displaydevice including: a communication part configured to transmit andreceive data; a receiver configured to receive a user's input; and acontroller configured to control the communication part to obtain remotecontrol setting information corresponding to an electronic deviceconnected to the display device, to transmit the obtained remote controlsetting information to a remote controller of the display device, and totransmit the remote control setting information to an external server tobe uploaded to the user account.

According to still another exemplary embodiment, provided is a controlmethod of a display device, the control method including: connecting toan external server and logging in to the external server with a useraccount; obtaining remote control setting information of an electronicdevice uploaded to the user account; and transmitting the obtainedremote control setting information to a remote controller of the displaydevice.

According to still another exemplary embodiment, provided is a displaydevice including: a communication part configured to transmit andreceive data; a receiver configured to receive a user's input; and acontroller configured to control the communication part to connect to anexternal server and log in to the external server with a user account,to receive remote control setting information of an electronic deviceconnected to the display device, which is uploaded to the user account,and to transmit the obtained remote control setting information to aremote controller of the display device.

According to still another exemplary embodiment, provided is a userterminal apparatus including: a storage configured to store anapplication for remote control of a plurality of electronic devices,connected to the user terminal apparatus, and ID information of theplurality of electronic devices; a user input part configured to receivea user command for remote control of an electronic device among theplurality of electronic devices; a communication part configured totransmit and receive data; and a controller configured to, in responseto the user command, determine whether remote control setting isperformed for the electronic device, control the communication part toobtain a control key corresponding to the electronic device based on IDinformation of the electronic device, and control the application toremotely control the electronic device by using the obtained controlkey.

The user terminal apparatus may further include a display unit, whereinthe ID information is stored and displayed in an image on the displayunit.

When the image displayed on the display unit is selected, theapplication for remote control may be executed with respect to anelectronic device of which ID information corresponds to the selectedimage.

The communication part may obtain the control key corresponding to theelectronic device from the electronic device.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects will become apparent and more readilyappreciated from the following description of the exemplary embodiments,taken in conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram of a display device according to an exemplaryembodiment;

FIG. 2 is a block diagram of a display device according to anotherexemplary embodiment;

FIG. 3 illustrates an example of a display device which is set withrespect to a remote controller and controlled by peripheral electronicdevices according to an exemplary embodiment;

FIG. 4 illustrates an example of a user interface (UI) for setting aremote controller in a display device according to an exemplaryembodiment;

FIG. 5 illustrates an example of a screen showing a completion ofsetting of a remote controller in a display device according to anexemplary embodiment;

FIG. 6 is a control flowchart showing operations of a display deviceaccording to an exemplary embodiment;

FIG. 7 is a control flowchart showing operations of a display deviceaccording to another exemplary embodiment;

FIG. 8 is a block diagram of a user terminal apparatus according to anexemplary embodiment;

FIG. 9 is a block diagram of a user terminal apparatus according toanother exemplary embodiment;

FIG. 10 is a control flowchart showing operations of a user terminalapparatus according to an exemplary embodiment;

FIG. 11 is a control flowchart showing operations of a user terminalapparatus according to another exemplary embodiment;

FIG. 12 is a block diagram of a user terminal apparatus which is capableof logging in an external server and sharing remote control settinginformation according to an exemplary embodiment;

FIG. 13 is a control flowchart showing operations of a user terminalapparatus which is capable of logging in an external server and sharingremote control setting information according to an exemplary embodiment;

FIG. 14 is a block diagram of a display device which logs in an externalserver and transmits remote control setting information according to anexemplary embodiment;

FIG. 15 is a control flowchart showing operations of a display devicewhich logs in to an external server and transmits remote control settinginformation according to an exemplary embodiment;

FIG. 16 is a control flowchart showing operations of a display devicewhich logs in an external server and receives remote control settinginformation according to an exemplary embodiment;

FIG. 17 illustrates an example of setting a remote control of anelectronic device by a user terminal apparatus according to an exemplaryembodiment;

FIG. 18 illustrates an example of setting a remote control of anelectronic device by a user terminal apparatus according to anotherexemplary embodiment;

FIG. 19 illustrates an example of capturing an image of an electronicdevice by a user terminal apparatus according to an exemplaryembodiment;

FIG. 20 illustrates an example of setting a remote control and sharingremote control setting information by a user terminal apparatus and adisplay device according to an exemplary embodiment; and

FIG. 21 illustrates an example of setting a remote control of anelectronic device by a user terminal apparatus and sharing remotecontrol setting information through an external server according to anexemplary embodiment.

DETAILED DESCRIPTION

Below, exemplary embodiments will be described in detail with referenceto accompanying drawings so as to be easily realized by a person havingordinary knowledge in the art. The exemplary embodiments may be embodiedin various forms without being limited to the exemplary embodiments setforth herein. Descriptions of well-known parts are omitted for clarity,and like reference numerals refer to like elements throughout.

FIG. 1 is a block diagram of a display device 1 according to anexemplary embodiment. As shown in FIG. 1, the display device 1 accordingto an exemplary embodiment may include an interface part 110, acommunication part 120, an image processor 130, a display unit 140, anda controller 100.

The interface part 110 exchanges data with an external input source. Theexternal input source may include a graphic card to convert generateddata into an image signal and transmit the image signal to the displaydevice 1, and may store therein a predetermined graphic card patch tocorrect colors of the image signal. The external input source may beimplemented as a personal computer (PC), but not limited thereto. Theinterface part 110 may exchange data with the external input sourcethrough, for example, digital visual interface (DVI), component, highdefinition multimedia interface (HDMI) or serial digital interface(SDI).

The interface 110 operates to transmit a signal from a connector (notshown) to the controller 100 or to the image processor 130, or transmita signal from the controller 100 or the image processor 130 to theconnector. The interface part 110 relays and transmits signals and actsas an interface for signals among elements of the display device 1. Inthe exemplary embodiment, the interface part 110 is shown as separatefrom the image processor 130 and controller 100, but not limitedthereto. Alternatively, the interface part 110 may be integrally formedwith the image processor 130 or the controller 100 or may be incidentalthereto.

If the connector is based on a universal serial bus (USB), the interfacepart 110 may be implemented as a USB controller module which isconnected to the connector and controls transmission of signals throughthe connector.

The communication part 120 receives an external input signal andtransmits the signal to the image processor 130. The communication part120 may be connected to various types of external input cables and mayreceive an external input signal in a wired manner or in a wirelessmanner according to a predetermined wireless communicationspecification.

The communication part 120 may include a plurality of connectors (notshown) to which respective cables are connected independently. Thecommunication part 120 may receive signals from connected externalinputs, e.g., broadcasting signals, image signals, and data signalsaccording to high definition multimedia interface (HDMI), universalserial bus (USB), or component, or receive communication data through acommunication network.

In addition to elements for receiving signals and/or data from theconnected external inputs, the communication part 120 may furtherinclude various elements such as a wireless communication module (notshown) for wireless communication or a tuner (not shown) for turningbroadcasting signals depending on a design type of the display device 1.The communication part 120 may transmit information including dataand/or signals of the display device 1 to an external device as well asreceiving signals from the external device. That is, the communicationpart 120 is not limited to receiving signals from an external device andmay be implemented as an interface for interactive communication. Thecommunication part 120 may receive a control signal from a plurality ofcontrol devices to select a user interface (UI). The communication part120 may include a communication module for wireless local areacommunication such as Bluetooth, Infrared (IR), Ultra Wideband (UWB), orZigbee, or include a communication port for wired communication. Thecommunication part 120 may be used for various purposes includingtransmission and reception of data and commands for manipulating thedisplay device 1 as well as receiving control signals for selecting aUI.

An image processing operation of the image processor 130 may include adecoding operation corresponding to an image format of image data, ade-interlacing operation for converting interlace image data intoprogressive image data, a scaling operation for adjusting image datainto a preset resolution, a noise reduction operation for improving aquality of an image, a detail enhancement operation, a frame refreshrate conversion, etc.

The image processor 130 may be implemented as a system-on-chip (SoC)which integrates the aforementioned functions or may be implemented asan image processing board (not shown), which is provided by installingelements for performing the aforementioned processes in a printedcircuit board (PCB). The image processor 130 may be installed in thedisplay device 1.

The image processor 130 processes a predetermined image signal todisplay an image based on the processed image signal. The imageprocessor 130 may further process an image signal to display an imageincluding at least one graphic user interface (GUI) based on theprocessed image signal. The image which is processed by the imageprocessor 130 may be output to, and displayed by, the display device 1.The display device 1 may be, for example, a monitor or a television(TV).

The display unit 140 may display an image thereon based on an imagesignal output from the image processor 130. The display unit 140 may beimplemented as various displays such as a liquid crystal display (LCD),a plasma display panel (PDP), a light emitting diode (LED), an organiclight emitting diode (OLED), a surface-conduction electron-emitter, acarbon nano-tube, a nano-crystal, etc., but not limited thereto.

The display unit 140 may further include additional elements dependingon an embodiment. For example, when the display unit 140 is implementedas an LCD, the display unit 140 may include an LCD panel (not shown), abacklight unit (not shown) which emits light to the LCD panel, and apanel driving substrate (not shown) which drives the LCD panel.

The display unit 140 displays an image thereon based on the image signalprocessed by the image processor 130. The display unit 140 may includean LCD, a PDP or an OLED but not limited thereto. In this case, thedisplay unit 140 may further include an LCD panel, a PDP panel or anOLED panel.

The display unit 140 may display thereon images and perform a colorcorrection process. The display unit 140 may include a display panel(not shown) to display an image thereon, and a panel driver (not shown)to process an input image signal and display an image on the displaypanel based on the processed image signal. The display unit 140 is notlimited to a particular implementation type. The image signal which isreceived by the interface part 110 from the external input source may beprocessed, e.g., decoded, deinterlaced, or scaled to be displayed on thedisplay unit 140.

The controller 100 may control overall internal elements of the displaydevice 1. The controller 100 checks whether a control setting of aremote controller has already been performed to remotely control aplurality of electronic devices based on received identification (ID)information, and if not, the controller 100 may control thecommunication part 120 to receive a control key of the remote controllercorresponding to the received ID information and to transmit thereceived control key to the remote controller.

FIG. 2 is a block diagram of the display device 1 according to anotherexemplary embodiment. As shown in FIG. 2, the display device 1 accordingto another exemplary embodiment may further include a UI generator 150and a storage 160 as well as the elements shown in FIG. 1.

The UI generator 150 may generate a UI to operate an executedapplication program. The generated UI may include a plurality of sub UIsin a form of icons or texts. If a user selects a particular sub UIthrough the display device 1, an application program may be operatedcorresponding to the selected sub UI. That is, respective sub UIs may begenerated in a unit of function or event to operate the applicationprogram executed by the display device 1.

The UI generator 150 provides software or hardware functionality forgenerating and controlling a UI displayed on the display unit 140, andsuch functionality may be performed by the controller 100. That is,there is no need to implement the UI generator 150 to include anadditional chipset or a microprocessor.

The storage 160 may include a writable read only memory (ROM) in whichdata remain even when power is cut off from the display device 1, andany change may be reflected in respect of the user. That is, the storage160 may be implemented as, for example, a flash memory, an erasableprogrammable read only memory (EPROM), or an electrically erasableprogrammable read only memory (EEPROM).

The controller 100 may receive a control key from electronic devicesconnected to the display device 1. When the electronic devices have nocontrol key, the electronic devices may request an external server totransmit a control key corresponding to a model of the electronicdevices and receive the control key therefrom. The ID information mayinclude, for example, a manufacturer and a model name of the electronicdevices. The interface part 110 is connected to the controller 100through HDMI, and the controller 100 may control the interface part 110to receive ID information of the plurality of electronic devices. Thedisplay device 1 may include the UI generator 150 to display a UI whichis used to select a control setting. The controller 100 may notify theelectronic devices, for which no control setting has been performed. Thecontroller 100 may control the UI generator 150 to display a UI which isused to select the control setting. The controller 100 may check whetheran HDMI connection port has been changed, and if so, may change an HDMIconnection port setting and receive the ID information through thechanged HDMI connection port.

FIG. 3 illustrates an example of the display device 1 which is set withrespect to a remote controller 6 and is controlled by peripheralelectronic devices 2 to 4 according to an exemplary embodiment.

The display device 1 according to the exemplary embodiment as shown inFIG. 3 is connected to a set-top box 2 to receive broadcasting signalsand satellite signals, a home theater 3 to reproduce movies, and ablue-ray player 4 to reproduce higher quality images. When the connectedthree electronic devices 2 to 4, i.e., the set-top box 2, the hometheater 3, and the blue-ray player 4 are turned on, the display device 1may check whether a remote controller setting has been performed withrespect to the three electronic devices 2 to 4. When it is checked that,for example, no remote controller setting has been performed for theset-top box 2, a UI may be displayed to inquire of the user whether toset the remote controller 6 for the set-top box 2. If the user selectsto set the remote controller 6 for the set-top box 2, the display device1 checks whether the set-top box 2 has a control key, and if so, mayreceive the control key therefrom and transmit the control key to theremote controller 6. Thus, the user may control the peripheralelectronic devices 2 to 4 of the display device 1 by using the singleremote controller 6. As shown in FIG. 3, when the display device 1 setsthe set-top box 2 through an external input key of the remote controller6, the user may control the set-top box 2 with the corresponding remotecontroller 6. In the related art, the user needs to check whether aremote controller selected by the user is a remote controller of theset-top box 2 and set the remote controller of the set-top box 2.However, in the display device 1 according to the exemplary embodiment,the user may simply check a newly connected electronic device and setremote control of the electronic device with the single remotecontroller 6. Therefore, the user may control the peripheral electronicdevices 2 to 4 with the single remote controller 6, without theaforementioned complicated processes in the related art.

FIG. 4 illustrates an example of a UI 152 for setting the remotecontroller 6 in the display device 1 according to an exemplaryembodiment.

In the UI 152, an inquiry of whether the user desires to set the remotecontroller for the set-top box 2 is displayed on the display device 1.When the user select a “YES” button from “YES” and “NO” buttons in theUI 152, setting of the remote controller 6 is performed. Specifically,the display device 1 may search for the set-top box 2 and automaticallyset a control key corresponding to the set-top box 2 instead of a user'ssearching for and setting the remote controller 6 for the set-top box 2.As shown in FIG. 3, the user may perform control setting of the remotecontroller 6 with a knowledge that the setting of the remote controller6 has not been performed for the set-top box 2.

FIG. 5 illustrates an example of a screen showing a completion ofsetting of the remote controller 6 in the display device 1 according toan exemplary embodiment.

When the user pushes the “YES” button in FIG. 4 and the remote controlsetting is completed for the set-top box 2, “external input: HDMI” and“type of device: set-top box 2” are displayed as shown in FIG. 5. Theuser may move, select and control the peripheral electronic devices 2 to4 through, for example, direction keys (or arrow keys) of the remotecontroller 6.

FIG. 6 is a control flowchart showing operations of the display device 1according to an exemplary embodiment.

In FIG. 6, it is assumed that the display device 1 is connected to theplurality of electronic devices 2 to 4. The peripheral electronicdevices 2 to 4 are turned on by a user or through other means (S11).Next, the controller 100 receives the ID information of at least one ofthe connected electronic devices 2 to 4 from the plurality of electronicdevices 2 to 4 (S12). The controller 100 checks whether the controlsetting of the remote controller 6 has already been performed for theplurality of electronic devices 2 to 4 (S13). If the control setting ofthe remote controller 6 has been performed for the electronic devices 2to 4, a control setting process is skipped (S16). The display device 1receives a control key of the remote controller 6 corresponding to theID information of the electronic devices 2 to 4 for which no controlsetting of the remote controller 6 has been performed (S14). Thecontroller 100 transmits the control key to the remote controller 6(S15). Thus, the single remote controller 6 may control the plurality ofelectronic devices 2 to 4.

FIG. 7 is a control flowchart showing operations of the display device 1according to another exemplary embodiment.

The display device 1 is connected to the plurality of electronic devices2 to 4, and the peripheral electronic devices 2 to 4 are turned on by auser or through other means (S21). The controller 100 checks whether theHDMI connection port has been changed (S22). If yes, the controller 100changes the HDMI connection port setting (S23). Next, the controller 100receives ID information such as information on the manufacturer and themodel name of the connected electronic devices 2 to 4 from the pluralityof electronic devices 2 to 4 (S24). If no HDMI connection port has beenchanged, operation S23 is skipped and operation S24 is performed. Thecontroller 100 checks the received ID information on the manufacturerand the model name and checks whether the control setting of the remotecontroller 6 has been performed (S25). If the control setting of theremote controller 6 has been performed (“yes” to operation S25), thecontrol setting process is skipped (S31). If the control setting of theremote controller 6 has not been performed (“no” to operation S25), a UIis displayed to perform the control setting of the remote controller 6(S26). Next, the controller 100 checks whether to perform the controlsetting (S27). If no control setting is to be performed, the controlsetting is skipped (S31) and the control setting process is terminated.If the control setting of the remote controller 6 is to be performed,the controller 100 checks whether the control key is received from theconnected electronic devices 2 to 4 (S28). If the electronic devices 2to 4 have the control key, the controller 100 receives the control keyfrom the electronic devices 2 to 4 and transmits the control key to theremote controller 6 (S29). If the electronic devices 2 to 4 have nocontrol key, the controller 100 requests an external server to transmita control key corresponding to the model name of the connectedelectronic devices 2 to 4, and transmits the received control key to theremote controller 6 (S30).

The display device 1 may receive the ID information of the peripheralelectronic devices 2 to 4 connected thereto, may receive the control keyof the remote controller 6 from at least one of the electronic devices 2to 4 for which no control setting of the remote controller 6 has beenperformed, and transmit the control key to the remote controller 6 toautomatically set the control key corresponding to the ID information.Thus, complicated processes may be avoided and the control setting maybe performed without much difficulty.

FIG. 8 is a block diagram of a user terminal apparatus 10 according toan exemplary embodiment. As shown in FIG. 8, the user terminal apparatus10 according to an exemplary embodiment may include an input part 210, acommunication part 220, a storage 230 and a controller 200. The userterminal apparatus 10 may be implemented as, for example, a smart phone,a tablet PC, or a laptop computer.

The input part 210 may be used to input the ID information of electronicdevices 2 to 4 including at least one of an image and an audio relatedto the electronic devices 2 to 4. The user terminal apparatus 10 mayinclude the input part 210 provided in a display unit (not shown) suchas a touch screen. The input part 210 may be provided for a user toinput the model name or the manufacturer of the electronic devices 2 to4. The input part 210 may receive and transmit the image and the audiorelated to the electronic devices 2 to from and to the outside to thecontroller 200. The input part 210 may be separate from the display unitand may receive a user's input.

The communication part 220 receives an external input signal andtransmits the external input signal to an image processor (not shown)through the controller 200. The communication part 220 is connected tovarious types of external input cables and may receive the externalinput signal in a wired manner or a wireless manner according to apredetermined wireless communication specification.

The communication part 220 may include a plurality of connectors (notshown) to which cables are respectively connected. The communicationpart 220 may receive signals from connected external inputs, e.g.,broadcasting signals, image signals and data signals according to HDMI,USB, or component, or receive communication data through a communicationnetwork.

In addition to the above elements for receiving signals and/or data fromthe external inputs, the communication part 220 may further includevarious elements such as a wireless communication module (not shown) forwireless communication or a tuner (not shown) for turning broadcastingsignals depending on a design type of the user terminal apparatus 10.The communication part 220 may transmit information including as dataand/or signals of the display device 1 to an external device as well asreceiving signals from the external device. That is, the communicationpart 220 is not limited to receiving signals from the external deviceand may be implemented as an interface for interactive communication.The communication part 220 may receive a control signal from a pluralityof control devices to select a UI. The communication part 220 mayinclude a communication module for wireless local area communicationsuch as Bluetooth, Infrared (IR), Ultra Wideband (UWB), or Zigbee, orinclude a communication port for wired communication. The communicationpart 220 may be used for various purposes including transmission andreception of data and commands for manipulating displays as well asreceiving control signals for selecting a UI.

The storage 230 may include a writable ROM in which data remain evenwhen power is cut off from the display device 10, and any change may bereflected in respect of a user. That is, the storage 230 may beimplemented as, for example, a flash memory, an EPROM or an EEPROM. Thestorage 230 may store therein an application 232 to remotely control theelectronic devices 2 to 4.

The controller 200 may control overall internal elements of the userterminal apparatus 10. The controller 200 may receive a control keycorresponding to the electronic devices 2 to 4 based on input IDinformation and control the application 232 to remotely control theelectronic devices 2 to 4 with the received control key.

FIG. 9 is a block diagram of the user terminal apparatus 10 according toanother exemplary embodiment. As shown in FIG. 10, the user terminalapparatus 10 according to another exemplary embodiment may furtherinclude an image processor 240 and a display unit 250 as well as theinput part 210, the communication part 220, the storage 230 and thecontroller 200 in FIG. 8.

The input part 210 may include a camera 212 which captures an image anda microphone 214 which receives audio.

The image processing operation of the image processor 240 may include adecoding operation corresponding to an image format of image data, ade-interlacing operation for converting interlace image data intoprogressive image data, a scaling operation for adjusting image datainto a preset resolution, a noise reduction operation for improving aquality of an image, a detail enhancement operation, a frame refreshrate conversion, etc.

The image processor 240 may be implemented as a system-on-chip (SoC)which integrates the aforementioned functions or may be implemented asan image processing board (not shown) which is provided by installingelements for performing the aforementioned processes in a printedcircuit board (PCB). The image processor 240 may be installed in thedisplay device 10.

The image processor 240 processes image signals received through thecommunication part 120, broadcasting signal including image signalsstored in the storage 230, and source images including image signalssupplied by an image supply source (not shown). The image processor 240outputs the processed image signal to the display device 10, in whichthe processed source image may be displayed.

The display unit 250 may display an image thereon based on an imagesignal output from the image processor 240. The display unit 250 may beimplemented as various displays such as an LCD, a PDP, an LED, an OLED,a surface-conduction electron-emitter, a carbon nano-tube, anano-crystal, etc., but not limited thereto.

The display unit 250 may further include additional elements dependingon its embodiment type. For example, the display unit 140 implemented asan LCD may include an LCD panel (not shown), a backlight unit (notshown) which emits light to the LCD panel, and a panel driving substrate(not shown) which drives the LCD panel.

The display unit 250 displays an image thereon based on the image signalprocessed by the image processor 240. The display unit 250 may includean LCD, a PDP or an OLED but not limited thereto. Also, the display unit250 may include an LCD panel, a PDP panel or an OLED panel.

The controller 200 may analyze the image captured by the camera 212 ofthe input part 210 and the audio input to the microphone 214 todetermine the ID information of the electronic devices 2 to 4. The imagecaptured by the camera 212 may include the model name of the electronicdevices 2 to 4. For example, the captured image may be related to aspecification including a bar code and a quick response (QR) code of theelectronic devices 2 to 4. The audio input to the microphone 214 may bethe model name of the electronic devices 2 to 4 spoken by a user. Thatis, when the user may speak the model name, a user's voice may be input.The controller 200 may convert the model name of the image into a textand use the text as the ID information of the electronic devices 2 to 4.Alternatively, the controller 200 may convert the model name input asthe audio into a text and use the text as the ID information of theelectronic devices 2 to 4.

The controller 200 may display an image of the ID information of theelectronic devices 2 to 4. Also, the controller 200 may store the user'svoice as an audio command to use the stored audio command to control theelectronic devices 2 to 4. The controller 200 may change the image ofthe ID information of the electronic devices 2 to 4 or the stored audiocommand. For example, the image of the electronic devices 2 to 4displayed in the user terminal apparatus 10 may be replaced by a desiredimage to be stored. If the stored desired image is selected, theelectronic devices 2 to 4 may be controlled. In the case of the audiocommand, the audio command, for example, “cooler, reduce temperature!”may be changed to and stored as an audio command of “cooler” to controlan air conditioner.

The controller 200 may check the electronic devices 2 to 4 which may bewirelessly connected to the user terminal apparatus 10 and the displaydevice 10. If the application 232 for remote control of the userterminal apparatus 10 is executed, peripheral connection status andcontrollable electronic devices 2 to 4 may be checked. Also, remotecontrol setting of the electronic devices 2 to 4 may be checked.

The controller 200 may set a connection port of the electronic devices 2to 4 and the display device 10. For example, when the user terminalapparatus 10 is carried by a user who is away from home and the userdesires to maintain the home cool, the user may transmit a controlcommand to the display device 10 and operate an electronic device, i.e.,an air conditioner by using wireless connection setting of the displaydevice 10 and the air conditioner.

The controller 200 may receive a control key from at least one of theelectronic devices 2 to 4, the display device 10, and an externalserver. The controller 200 may analyze ID information of the electronicdevices 2 to 4 through the image of the electronic devices 2 to 4, andreceive a control key from the concerned electronic devices 2 to 4 toremotely control the electronic devices 2 to 4. If the user terminalapparatus 10 is in a different location from the electronic devices 2 to4, the controller 200 may receive a control key from the external serverto remotely control the electronic devices 2 to 4 or receive a controlkey stored in the display device 10.

The controller 200 may be connected to the external server, log in theserver with a user account, and transmit to the external server remotecontrol setting information to upload setting information to the useraccount. The setting information may include a control key correspondingto the electronic devices 2 to 4.

FIG. 10 is a control flowchart showing operations of the user terminalapparatus 10 according to an exemplary embodiment.

If a user selects the application 232 to remotely control the electronicdevices 2 to 4, the controller 200 executes the application 232 storedin the storage 230 to remotely control the electronic devices 2 to 4(S41). The ID information of the electronic devices 2 to 4 including atleast one of an image and an audio related to the electronic devices 2to 4 is input (S42). The controller 100 receives the control keycorresponding to the electronic devices 2 to 4 based on the input IDinformation (S43). The electronic devices 2 to 4 are remotely controlledby the received control key (S44).

FIG. 11 is a control flowchart showing operations of the user terminalapparatus 10 according to another exemplary embodiment.

When a user selects the application 232 to remotely control theelectronic devices 2 to 4, the controller 200 executes the application232 stored in the storage 230 to remotely control the electronic devices2 to 4 (S51). The controller 200 checks the electronic devices 2 to 4which may be wirelessly connected to the user terminal apparatus 10 andthe display device 10 (S52). The remote control setting of the checkedelectronic devices 2 to 4 may also be displayed. The controller 200analyzes the captured image and the received audio related to theelectronic devices 2 to 4 to determine the ID information of theelectronic devices 2 to 4 (S53). The controller 200 may analyze theimage including a model name captured by the camera 212 and the audioincluding the model name to identify the electronic devices 2 to 4 forwhich the remote control is set. The controller 200 receives the controlkey corresponding to the ID information from at least one of theelectronic devices 2 to 4, the display device 10, and the externalserver (S54). The connection port of the electronic devices 2 to 4 andthe display device 20 is set (S55). This is performed to remotelycontrol the electronic devices 2 to 4, by the user terminal apparatus 10remotely located therefrom, e.g., outside home. The remote control ofthe electronic devices 2 to 4 is performed by using the received controlkey (S56). The controller 200 is connected to the external server andlogs in the external server with the user account (S57). The remotecontrol setting information is transmitted to the external server to beuploaded to the user account (S58).

FIG. 12 is a block diagram of a user terminal apparatus 11 for loggingin an external server with a user account and sharing remote controlsetting information according to another exemplary embodiment. As shownin FIG. 12, the user terminal apparatus 11 may include a communicationpart 320, a user input part 310, and a controller 300. The user terminalapparatus 11 may further include an input part 330, an image processor340, a display unit 360, and a storage 350 as in FIG. 9. Thecommunication part 320, the input part 330, the image processor 340, thedisplay unit 360 and the storage 350 are the same as those in FIG. 9,and the description thereof will be omitted.

The user input part 310 transmits various control commands orinformation to the controller 300 according to a user's manipulation andinput. The user input part 310 may be implemented as a menu key or inputpanel installed in an external part of the display device 10, or as aremote controller 6 which is separate and spaced apart from the displaydevice 10. Alternatively, the user input part 310 may be integrallyformed in the display unit 360. When the display unit 360 is a touchscreen, a user may touch an input menu (not shown) on the display unit360 to transmit a preset command to the controller 300.

The user input part 310 may receive a user's motion. The user's motionmay include a touch input. The user input part 310 may directly receivethe user's motion or receive information of the user's motion from anexternal device.

The controller 300 may be connected to the external server, log in theexternal server with a user account, and control the communication part320 to receive remote control setting information of the electronicdevices 2 to 4 which has been uploaded to the user account and toremotely control the electronic devices 2 to 4 by using the receivedsetting information.

FIG. 13 is a control flowchart showing operations of logging in anexternal server with the user terminal apparatus 11 and sharing remotecontrol setting information by the user terminal apparatus 11 accordingto an exemplary embodiment.

The user terminal apparatus 11 is connected to the external server andlogs in the external server with the user account (S61). The userterminal apparatus 11 receives the setting information for remotecontrol of the electronic devices 2 to 4 which has been uploaded to theuser account (S62). The user terminal apparatus 11 remotely controls theelectronic devices 2 to 4 by using the received setting information(S63).

FIG. 14 is a block diagram of a display device 20 which logs in anexternal server with a user account and transmits remote control settinginformation according to an exemplary embodiment. As shown in FIG. 14,the display device 20 may include a communication part 410, a receiver420, an image processor 430, a display unit 440, a storage 450 and acontroller 400.

The receiver 420 transmits various preset control commands orinformation to the controller 400 according to a user's manipulation andinput. The receiver 420 may be implemented as a menu key or input panelinstalled in an external part of the display device 20 or as a remotecontroller 6 which is separate and spaced apart from the display device20. Alternatively, the receiver 420 may be integrally formed in thedisplay unit 440. When the display unit 440 is a touch screen, a usermay touch an input menu (not shown) on the display unit 440 to transmita preset command to the controller 400.

The communication part 410 receives an external input signal andtransmits the external input signal to the image processor 430. Thecommunication part 410 is connected to various types of external inputcables and may receive the external input signal in a wired manner orreceive a signal in a wireless manner according to a predeterminedwireless communication specification.

The communication part 410 may include a plurality of connectors (notshown) to which respective cables are connected. The communication part410 may receive signals from the connected external inputs, e.g.,broadcasting signals, image signals and data signals according to HDMI,USB or Component or receive communication data through a communicationnetwork.

In addition to the elements for receiving signals and/or data fromexternal inputs, the communication part 410 may further include variouselements such as a wireless communication module (not shown) forwireless communication or a tuner (not shown) for turning broadcastingsignals depending on a design type of the display device 20. Thecommunication part 410 may transmit information including data and/orsignals of the display device 20 to an external device as well asreceiving signals from the external device. That is, the communicationpart 410 is not limited to receiving signals from an external device andmay be implemented as an interface for interactive communication. Thecommunication part 410 may receive a control signal from a plurality ofcontrol devices to select a UI. The communication part 410 may include acommunication module for wireless local area communication such asBluetooth, Infrared (IR), Ultra Wideband (UWB), or Zigbee or include acommunication port for wired communication. The communication part 410may be used for various purposes including transmission and reception ofdata and commands for manipulating displays as well as receiving controlsignals for selecting a UI.

The storage 450 may include a writable ROM in which data remain evenwhen power is cut off from the display device 20 and any change may bereflected in respect of a user. That is, the storage 450 may beimplemented as, for example, a flash memory, an EPROM, or an EEPROM. Thestorage 450 may store therein an application for remote control ofelectronic devices.

The image processing operation of the image processor 430 may include adecoding operation corresponding to an image format of image data, ade-interlacing operation for converting interlace image data intoprogressive image data, a scaling operation for adjusting image datainto a preset resolution, a noise reduction operation for improving aquality of an image, a detail enhancement operation, a frame refreshrate conversion, etc.

The image processor 430 may be implemented as a system-on-chip (SoC)which integrates the aforementioned functions or may be implemented asan image processing board (not shown) which is provided by installingelements for performing the aforementioned processes in a printedcircuit board (PCB). The image processor 430 may be installed in thedisplay device 20.

The image processor 430 processes image signals received through thecommunication part 410, broadcasting signal including image signalsstored in the storage 450, and source images including image signalssupplied by an image supply source (not shown). The image processor 430outputs the processed image signal to the display device 20, on whichthe processed source image may be displayed.

The display unit 440 may display an image thereon based on the processedimage signal output from the image processor 430. The display unit 440may be implemented as various displays such as an LCD, a PDP, an LED, anOLED, a surface-conduction electron-emitter, a carbon nano-tube, anano-crystal, etc., but not limited thereto.

The display unit 440 may further include additional elements dependingon an embodiment type thereof. For example, the display unit 440 as anLCD may include an LCD panel (not shown), a backlight unit (not shown)which emits light to the LCD panel, and a panel driving substrate (notshown) which drives the LCD panel.

The display unit 440 displays an image thereon based on the image signalprocessed by the image processor 430. The display unit 440 may includean LCD, a PDP or an OLED but not limited thereto. The display unit 440may also include an LCD panel, PDP panel or OLED panel.

The controller 400 may control the communication part 410 to receiveremote control setting information corresponding to the electronicdevices connected to the display device 20, to transmit the receivedsetting information to the remote controller 6. Also, the controller 400may control the communication part 410 to log in to the external serverwith the user account and to transmit the setting information to theexternal server to upload the setting information to the user account.

FIG. 15 is a control flowchart showing operations of logging in anexternal server with a user account and transmitting remote controlsetting information by the display device 20 according to an exemplaryembodiment.

The display device 20 receives the remote control setting informationcorresponding to the electronic devices 2 to 4 connected to the displaydevice 20 (S71). The display device 20 transmits the received settinginformation to the remote controller 6 (S72). The display device 20 isconnected to the external server and logs in to the external server withthe user account (S73). The display device 20 transmits the settinginformation to the external server to upload the setting information tothe user account (S74).

FIG. 16 is a control flowchart showing operations of logging in anexternal server with a user account and receiving remote control settinginformation by the display device 20 according to an exemplaryembodiment.

The display device 20 is connected to the external server and logs inthe user account (S81). The display device 20 receives remote controlsetting information which has been uploaded to the user account (S82).The display device 20 transmits the received setting information to theremote controller 6 which remotely controls the electronic devices 2 to4 (S83).

FIG. 17 illustrates an example of setting a remote control of electronicdevices 2 to 5 by the user terminal apparatus 10 according to anexemplary embodiment.

As shown in FIG. 17, display device 20 is connected to the set-top box2, the home theater 3 and the blue-ray player 4 in a wired mannerthrough HDMI, and an air conditioner is connected in a wireless mannerthrough Bluetooth. The application 232 for remote control of electronicdevices 2 to 5 is executed to remotely control an air conditioner 5 byusing the user terminal apparatus 10. The controller 200 of the userterminal apparatus 10 checks whether the air conditioner 5 is wirelesslyconnectable and captures an image of a specification including a barcode and a QR code of the air conditioner 5. The user terminal apparatus10 sequentially checks whether a control key is received from at leastone of the air conditioner 5, the display device 20 and the externalserver. The controller 200 sets a wireless connection port of thedisplay device 20 and the air conditioner 5. Thus, the user terminalapparatus 10 may easily perform the remote control setting to remotelycontrol the air conditioner 5.

Similarly to the display device 20, the user terminal apparatus 10 mayalso display remotely controllable electronic devices 2 to 5 on thedisplay unit 250 and may select and remotely control any desiredelectronic devices 2 to 5.

FIG. 18 illustrates an example of setting a remote control of theelectronic devices 2 to 5 by the user terminal apparatus 10 according toanother exemplary embodiment.

(a) in FIG. 18 shows an application 232 for remote control of theelectronic devices 2 to 5.

(b) in FIG. 18 shows selection of capturing an image or an audio inputwith respect to ID information of the electronic devices 2 to 5.

(c) in FIG. 18 shows an image captured for a specification including abar code and a QR code of the electronic devices 2 to 5.

(d) in FIG. 18 shows selection of connection ports 235 and 236 of theelectronic devices 2 to 5 and the display device 20.

(d) in FIG. 18 shows notification of completion of the remote controlsetting from the electronic devices 2 to 5.

FIG. 19 illustrates an example of an image of the electronic devices 2to 5 captured by the user terminal apparatus 10 according to anexemplary embodiment. As shown in FIG. 19, a specification of theelectronic devices 2 to 5 is captured by the camera 212, and thecontrollers 200 and 300 may analyze the model name as shown in {circlearound (a)} of the captured image. The controller 200 may request theexternal server to transmit a control key for remote control of theanalyzed model name, request the display device 20 to transmit a controlkey for the analyzed model name, or directly receive the control keyfrom the electronic devices 2 to 5 in a wireless manner. Although it isdescribed that the user terminal apparatus 10 is used for the remotecontrol setting in this exemplary embodiment, it should be noted thatthe user terminal apparatus 11 may also be used for remote controlsetting in a similar manner.

FIG. 20 illustrates an example of setting remote control and sharingremote control setting information by the user terminal apparatus 10 andthe display device 20 according to an exemplary embodiment.

FIG. 20 shows a remote control by the remote controller 6. When thedisplay device 20 is turned on, the remote controller 6 checks theperipheral electronic devices 2 to 5 connected to the display device 20and checks whether the remote control setting has been performed to oneof the electronic devices 2 to 5, e.g., the set-top box 2. If not, thedisplay device 20 requests the set-top box 2 or the external server 7 totransmit a control key for corresponding to the set-top box 2. Thedisplay device 20 transmits the received control key to the remotecontroller 6 as indicated by a dashed arrow line {circle around (5)} sothat the remote controller 6 may remotely control the set-top box 2 asindicated by a dashed arrow line {circle around (2)}. When an externalinput button of the remote controller 6 is pressed, the display device20 may display an external input selection screen to control theperipheral electronic devices 2 to 5 and allow the remote controller 6to remotely control the electronic devices 2 to 5.

A dashed arrow line {circle around (3)} shows a remote control settingof the blue-ray player 4 by the user terminal apparatus 10. If theapplication 232 for remote control of the electronic devices 2 to 5 isexecuted, the controller detects the blue-ray player 4 for which noremote control setting has been performed and captures specificationinformation of the blue-ray player 4 through the camera 212 of the userterminal apparatus 10 or 11. The user terminal apparatus 10 requests theblue-ray player 4, the display device 20, or the external server 7 totransmit a control key to remotely control the blue-ray player 4 andreceives the control key therefrom. When the connection port of theblue-ray player 4 and the display device 20 is selected and set in awired manner, the user terminal apparatus 10 may remote control theblue-ray player 4.

A dashed arrow line {circle around (4)} shows the displays device 20which may transmit a control key of the set-top box 2 to the externalserver 7 and receive setting information including a control key forremote control of the blue-ray player 4. The display device 20 receivesthe control key of the connected set-top box 2 from the external server7 and transmits the control key to the remote controller 6 to remotelycontrol the set-top box 2 through the remote controller 6. Also, thedisplay device 20 may log in the account server 7 with the user accountand transmit the remote control setting information including thecontrol key for the set-top box 2 to the user account of the externalaccount server 7 to upload the setting information thereof. In thisexemplary embodiment, it is described that the external server 7 and theexternal account server 7 are integrally provided. Alternatively, theexternal server 7 and the account server 7 may be separately provided.

The display device 20 may be set to automatically log in to the useraccount once the display device 20 is turned on. The display device 20may log in the user account, check the remote control settinginformation of the blue-ray player 4 uploaded to the user account, andreceive the remote control setting information of the blue-ray player 4for which no remote control setting has been previously performed. Sincethe remote control setting information of the blue-ray player 4 has beenupdated by the user terminal apparatus, the display device 20 mayreceive the remote control setting information of the blue-ray player 4,and transmit the setting information to the remote controller 6 toremotely control the blue-ray player 4 as indicated by the dashed arrowline {circle around (5)}.

A dashed arrow line {circle around (6)} shows the user terminalapparatus 10 which may transmit a control key of the blue-ray player 4to the external server 7 and receive setting information including acontrol key for remote control of the set-top box 2.

In the process shown in the dashed arrow line {circle around (3)}, theuser terminal apparatus 10 receives the control key of the blue-rayplayer 4 and, in the process shown in the dashed arrow line {circlearound (6)}, may log in the user account and transmit the remote controlsetting information including the control key for the blue-ray player 4to the user account of the external account server 7 to upload thesetting information to the user account. Also, the user terminalapparatus 10 may log in the user account, check the remote controlsetting information of the set-top box 2 uploaded to the user account,and receive the remote control setting information of the set-top box 2for which no remote control setting has been performed. Since the remotecontrol setting information of the set-top box 2 has been updated by thedisplay device 20, the user terminal apparatus 10 may receive the remotecontrol setting information of the set-top box 2 and remotely controlthe set-top box 2.

The display device 20 and the user terminal apparatus 10 may exchangethe remote control setting information of the electronic devices 2 to 5with the external server 7, and as indicated by a dashed arrow line{circle around (7)}, the user terminal apparatus 10 may directlytransmit the remote control setting information of the electronicdevices 2 to 5 to the display device 20, and the display device 20 maydirectly transmit the control remote setting information to the userterminal apparatus 10. Although it is described that the user terminalapparatus 10 is used for the remote control setting in this exemplaryembodiment, it should be noted that the user terminal apparatus 11 mayalso be used for remote control setting in a similar manner.

FIG. 21 illustrates an example of user terminal apparatus 10 whichperforms a remote control setting for the electronic devices 2 to 5 andshares remote control setting information through the external server 7.

In an exemplary embodiment, a user may perform the remote controlsetting ({circle around (11)}) for the air conditioner 5 in an area 2300outside a user's home, wherein the electronic devices 2 to 5 are placedin an area 2100 inside the user's home. When the remote control settingis performed for the air conditioner 5, the user terminal apparatus 10may transmit the remote control setting information of the airconditioner 5 to the user account of the external account server 7,which is located in a remote area 2200 ({circle around (12)}). In thiscase, when the display device 20 logs in to the user account of theexternal account server 7, the display device 20 may receive the remotecontrol setting information of the air conditioner 5 which has been setby the user terminal apparatus 10 ({circle around (13)}) and transmitthe setting information to the remote controller 6 ({circle around(14)}). Accordingly, the remote controller 6 may remotely control theelectronic devices 2 to 5 without performing the remote control settingprocess.

In another exemplary embodiment, when electronic devices 2 to 5 arenewly purchased, or a connection of the electronic devices 2 to 5 andthe display device 20 is changed such that a remote control settingneeds to be performed for the electronic devices 2 to 5, or when a userwho is away from home wants to remotely control the electronic devices 2to 5, the user may log in to the external account server 7 with the useraccount through the user terminal apparatus 10 to receive remote controlsetting information of the electronic devices 2 to 5. Thus, theelectronic devices 2 to 5 may be remotely controlled through the userterminal apparatus 10 without performing the remote control settingprocess for each of the electronic devices 2 to 5.

The user terminal apparatus 10 may input ID information of theelectronic devices 2 to 5 with images and audio to receive a control keycorresponding to the electronic devices 2 to 5 and thus the user mayremotely control the electronic devices 2 to 5 without much difficulty.

The user terminal apparatus 10 or the display device may log in theexternal account server 7 with the user account and perform the remotecontrol setting for the electronic devices 2 to 5.

Although it is described that the user terminal apparatus 10 is used forthe remote control setting in this exemplary embodiment, it should benoted that the user terminal apparatus 11 may also be used for remotecontrol setting in a similar manner.

The display device according to exemplary embodiments receives the IDinformation of peripheral electronic devices connected to the displaydevice, receives the control key of the remote controller 6 with respectto an electronic device for which no remote controller 6 has been set,and transmits the control key to the remote controller 6 toautomatically set the control key corresponding to the ID information.Thus, the control setting process may be simplified and easier.

The user terminal apparatus according to exemplary embodiments inputs IDinformation of an electronic device through an image and an audio andreceives a control key corresponding to the electronic device and mayremotely control the electronic device by using the received control keywithout much difficulty.

The user terminal apparatus or the display device according to exemplaryembodiments logs in a user account of an external server and performremote control setting of the electronic device using control settinginformation of the electronic device received from the external serverwithout much difficulty.

Although a few exemplary embodiments have been shown and described, itwill be appreciated by those skilled in the art that changes may be madein these exemplary embodiments without departing from the principles andspirit of the inventive step, the range of which is defined in theappended claims and their equivalents.

What is claimed is:
 1. A control method of a user terminal apparatus,the control method comprising: executing an application, stored in theuser terminal apparatus, for remote control of a plurality of electronicdevices connectable to the user terminal apparatus; transmitting to adisplay device a request with regard to the plurality of electronicdevices; selecting an electronic device among the plurality ofelectronic devices; receiving ID information of the selected electronicdevice from the display device, the display device being separate fromthe electronic device; transmitting, to another device, the received IDinformation of the electronic device to request for a control key,corresponding to the electronic device; receiving, from the anotherdevice, the control key corresponding to the electronic device based onthe transmitted ID information; and remotely controlling, by using theapplication, an operation of the electronic device by using the receivedcontrol key.
 2. The control method according to claim 1, wherein thereceiving the ID information comprises receiving the ID information ofthe electronic device comprising at least one of an image and an audiorelated to the electronic device, analyzing the at least one of thereceived image and the received audio, and determining the IDinformation of the electronic device.
 3. The control method according toclaim 1, wherein the receiving the control key corresponding to theelectronic device comprises setting a connection port with respect tothe electronic device and the display device, respectively.
 4. Thecontrol method according to claim 1, further comprising: receiving thecontrol key from at least one of the electronic device and an externalserver.
 5. The control method according to claim 1, further comprising:connecting to an external server and logging in to a user account of theexternal server; and transmitting remote control setting informationcorresponding to the electronic device to the external server to uploadthe remote control setting information to the user account.
 6. Thecontrol method according to claim 5, wherein the remote control settinginformation comprises the control key corresponding to the electronicdevice.
 7. A user terminal apparatus comprising: an input partconfigured to receive ID information of an electronic device comprisingat least one of an image and an audio related to the electronic device;a storage configured to store an application for remote control of theelectronic device; a communication part configured to transmit andreceive data; and a controller configured to transmit to a displaydevice a request with regard to a plurality of electronic devicesremotely controllable by the user terminal apparatus, to select anelectronic device among the plurality of electronic devices, to receiveID information of the selected electronic device from the displaydevice, the display device being separated from the electronic device,and to transmit the received ID information of the electronic device torequest for a control key corresponding to the electronic device, toanother device, control the communication part to receive, from theanother device, the control key corresponding to the electronic devicebased on the transmitted ID information, and remotely control anoperation of the electronic device by controlling the application byusing the received control key.
 8. The user terminal apparatus accordingto claim 7, wherein the input part comprises a camera to capture theimage and a microphone to receive the audio, and the controller analyzesthe captured image and the received audio and determines the IDinformation of the electronic device.
 9. The user terminal apparatusaccording to claim 7, wherein the controller sets a connection port withrespect to the electronic device and the display device, respectively.10. The user terminal apparatus according to claim 7, wherein thecontroller further receives the control key from at least one of theelectronic device and an external server.
 11. The user terminalapparatus according to claim 7, wherein the controller is connected toan external server and logs in to a user account of the external serverand transmit remote control setting information corresponding to theelectronic device to the external server to upload the remote controlsetting information to the user account.
 12. The user terminal apparatusaccording to claim 11, wherein the remote control setting informationcomprises the control key corresponding to the electronic device.
 13. Acontrol method of a user terminal apparatus, the control methodcomprising: transmitting to a display device a request with regard to aplurality of electronic devices; selecting an electronic device amongthe plurality of electronic devices; receiving ID information of theselected electronic device, from the display device; transmitting, tothe display device, the received ID information of the electronic deviceto request for remote control setting information corresponding to theelectronic device; receiving the remote control setting informationcorresponding to the electronic device, from the display device;connecting to an external server and logging in to a user account of theexternal server; uploading, to the user account of the external server,the received remote control setting information; obtaining second remotecontrol setting information of the electronic device uploaded to theuser account, wherein the second remote control setting information hasbeen previously uploaded by the display device by logging in theexternal server with the user account; and remotely controlling theelectronic device by using at least one of the remote control settinginformation and the second remote control setting information.
 14. Auser terminal apparatus comprising: a communication part configured totransmit and receive data; a user input part configured to receive auser's input; and a controller configured to: transmit to a displaydevice a request with regard to a plurality of electronic devices,select an electronic device among the plurality of electronic devices,receive ID information of the selected electronic device, from thedisplay device, and transmit, to the display device, the received IDinformation of the electronic device to request for remote controlsetting information corresponding to the electronic device, control thecommunication part to receive remote control setting informationcorresponding to the electronic device, from the display device, connectto an external server and log in the external server with a user accountto upload, to the user account of the second external server, thereceived remote control setting information, obtain second remotecontrol setting information of the electronic device uploaded to theuser account, wherein the second remote control setting information hasbeen previously uploaded by the display device by logging in theexternal server with the user account, and remotely control theelectronic device by using at least one of the remote control settinginformation and the second remote control setting information.
 15. Auser terminal apparatus comprising: a storage configured to store anapplication for remote control of a plurality of electronic devices,connected to the user terminal apparatus, and ID information of theplurality of electronic devices; a user input part configured to receivea user command for remote control of an electronic device among theplurality of electronic devices; a communication part configured totransmit and receive data from and to a display device, the displaydevice being separate from the electronic device and connected to theelectronic device; and a controller configured to, in response to theuser command, determine whether remote control setting is performed forthe electronic device, control the communication part to transmit to adisplay device a request with regard to the plurality of the electronicdevice, to select an electronic device among the plurality of electronicdevices, receive a control key corresponding to the electronic devicefrom another device based on the ID information of the electronicdevice, and remotely control an operation of the electronic device bycontrolling the application by using the received control key.
 16. Theuser terminal apparatus of claim 15, further comprising a display unit,wherein the ID information is stored and displayed in an image on thedisplay unit.
 17. The user terminal apparatus of claim 16, wherein, whenthe image displayed on the display unit is selected, the application forremote control is executed with respect to an electronic device of whichID information corresponds to the selected image.
 18. The user terminalapparatus according to claim 15, wherein the communication part obtainsthe control key corresponding to the electronic device from theelectronic device.